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ABSTRACT 

This paper describes the meeting of the Reading and 
Writing Advisory Committee of the New Jersey Basic Skills Council 
with selected high school English teachers and administrators. This 
panel established cut scores for statewide interpretation of the New 
Jersey College Basic Skills Placement Test (NJCBSPT) . The NJCBSPT is 
administered to all students admitted to New Jersey public colleges 
and universities. It is a placement test for remedial courses, 
according to standards set by each college, and a statewide basic 
skills assessment instrument. By advance agreement, the panelists 
used the Nedelsky Method for setting basic skills proficiency cut 
scores. Ground rules were made on the first day, objective test 
probability judgments on the second, and essay judgments on the 
third. Cut scores established are: Reading Comprehension, 155; 
Sentence Structure, 165; Logical Relationships, 168; Essay, 7; 
Composition, 169; Total English, 165. Attachments include: a 
description of the NJCBSPT; a list of conference panelists; the 
writing rubric; a Nedelsky Method Scoring Sheet; the essay rubric and 
scoring sheet; and a memorandum containing three panel 
recommendations and comments concerning the panel's limitations and 
potential. ( BS ) 
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SUBJECT: Establishing Cue Scores on the NJCBSPT Tests of Language Skills 



In order to establish Mew Jersey College Basic Skills Placement 
Test language skills cut scores (that is, the scores that are most 
likely to distinguish between remedial and non-renedial students), the 
Reading and Writing Advisory Committee of the Basic Skills Council net 
for two and one-half days at the Henry Chauncey Conference Center at 
Educational Testing Service in Princeton, Working •:Tith the CotmiLtee 
were five high school English teachers and administrators. 

This panel employed an established method that requires chat 
faculty analyze the multiple-choice language skills test and determine 
the probable number of items that an entering college freshman who 
does not need retiiediation should be expected to answer correct !/• This 
probable number of correct answers, determined by facul-y judgment, is 
called a cutting score or a cut score, and scores below the cut score, 
in the professional opinion of these faculty, probably indicate a need 
for remediation. 

In addition to an analysis of the multipl2--choice language skills 
tests, the panel also judged sixty pre-selected NJC3SPT essays and 
aetannined an essay cut score. 

The NJCBSPT cut scores tnac vere established reflect the pant^l's 
judgment of the scores that distinguish remedial and aon-re-.edlal students 
among the freshmen entering Mew Jersey public colleges anr^ universities 
in the fall* Tliese scores are not meant to establish s^nndards for anv 
:ne college: this niay only be done by faculty at each college. If a 
college faculty chooses to employ the statewide panel's Tiechod :^^r 
setting cut scores, it is critically important that zhe multipie-choice 
test items be examined in light cf locally developed specific objectives 
firmly established by local consensus and referred ta .is eacn Lz-jt^ i.s 
judged* 3y this method an institution establishes c ut score tnat 
reflects local standards. 



'^ile specific objectives are crucial in escablishing cut scares 
for placement in specific CQ»irS€S, such objectives are inappropriate 
in establishing statewide cut scores chat are developed with no single 
college, course, or standard in miad. Instead, general statewide cut 
scores are arrived at by a panel representative of New Jersey colleges 
and familiar with the language skills of entering college freshmen. 

The attached paper describes the method for establishing cut scores 
on the third version of the New Jersey College Basic Skills Placement 
Test. 



Attachment 



Est^^blishing Cat Scores on the 
New Jersey College Basic Skills Placement Test 



This paper describes the experience of a panel o£ New Jersey educators 
gathered at the Henry Chauncey Conference Center in Princeton for the 
purpose of establishing cut scores for the multlple^hoice and essay 
components of the New Jersey College Basic Skills PlacciMsnt Test (NJCBSPT) 
that is administered to all stud^ts entering New Jersey public colleges 
and universities and certain voluntary independent colleges (Attachment A 
is a description of the test). The panel was composed of college English 
faculty — members of the Reading and Writing Advisory Conanittee to the 
New Jersey Basic Skills Council; invited to work vith the Committee were 
high school English teachers and administrators recotsnended for their 
expertise and for their ties to professional organizations and/or highly 
visible remedial programs. Since the NJCBSPT cut scores (that is^ the 
scores that are most likely to distinguish between the remedial and non- 
remedial students) are used in public statements concerning the basic skills 
proficiencies of studcmts entering New Jersey colleges from New Jersey high 
schools, the Inclusion of New Jersey secondary school educators was considered 
appropriate and essential. A list of panelists is included as Attachment B. 

The New Jersey College Basic Skills Placesrent Test program is established 
by a resolution of the New Jersey Board of Higher Education; the resolution 
calls for the administration of the test to all students entering New Jersey 
public colleges and universities. The test is to be administered to students 
after admission, and the test results are to be used to place students in 
remedial courses according to the standards established by each college . 

In addition to serving as a placement test, the NJCBSPT is also a 
statewide basic skills assessment instrument for charting anticipated increases 
In statewide mean scores, and for sen/ing as a common measure in describing 
the basic skills standards of the various college sectors (community colleges, 
state colleges, Rutgers — The State University, New jersey Institute of 
Technology). Annually the Basic Skills Council reports on the results by 
college and sector for the entering college freshmen, and in that report the 
Council sets for each part of the test a cut score that indicates proficiency 
according to Council standards. The Council also reports annually on the 
NJCBSPT aggregate results for those New Jersey high schools that have test 
scores for ter or more students. 



Setting College Cut Scores 

For the n»st part, the methods used by insticutions to sec standards 
include the following, although some institutions use methods based on 
considerations not cited here** 



At certain colleges, placement into remedial courses is based aLT^ost 
exclusively on MJC3SPT scores; other colleges use prediction equations of 
varying complexity. 



!• Standards are sec from atace norms (usually the rnean standard 
score) 

2. Standards are set by faculty review of tests 

3. Standards of comparable institutions are used as a guide 

4. Standards are based on a college's own uorming studies 

5. Standards are set to accord with what is perceived to be statewide 
policy (i*e,, the Basic Skills Council's pro: iciency standards) 

6. Standards are set to accord with the number of seats allocated 
to basic skills courses 

7. Standards are set fay each division or department. 

The assortment of methods used to set cut scores is misleading: by 
far the most widespread method is faculty judgment. New Jersey is not unique 
in this regard, and College Credit and Placement by Examination; 1978 Guide 
to Institutional Policies indicates that institutions across the nation rely 
heavxly on collective faculty wisdom in establishing cut scores used to 
award credit or to deti^rmine placement. 

Upon the recommendation or the New Jersey Basic Skills Council's Tests 
and Measurements Advisory Committee, the Reading and Writing Advisory Committee 
agreed to analyze the content of the language skills test according to 
established procedures in order to determine what might be regarded as cut 
scores useful for statewide interpretation of WJCBSPT results, but not meant 
in any way to set standards for individual New Jersey post-secondar;/ insti- 
tutions. They were assisted in this work by selected secondary school 
educators. 



The Panelists 

rhe panel, chaired by the Directcr of the Mew Jersey Basic 'Skills 
Assessment Program, included eight college English teachers, one college 
'Philosophy teacher, a representative from the Department of Higher Education, 
two high school English teachers (one a departnient chair), the vice-principal 
of an urban high school basic skills program, a high school language arts 
super/isor, and an Education Information Center basic skills iuper/lsor. 
';ne secondary school administrator excused herself from the pao.el ifter rhe 
Friday evening zieeting. 

The panelists represented communitv colle'^es, state colleges, the 3 tare 
university, independent colleges, secondary and post-secondary adniinistration, 
and hi^h schools; in addition to sector representation, there were repr<3sentati 
:rom north, south, and central -ew Jersey, from ni^h school districts md 
colleges classified as urban, suburban, and rural/suburban. 7ive :)f :ihe 
oartijipants were ::e!iiald; one of zhese was jlacK, the .nilv :::inori:.y rcpr^/S^^n^.i: 
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Cholce of the Nedelsky Method 

The panelists had agreed in advance to sec MJC3SPT language skills 
axultiple-choice cut scores using the Nedelsky n^thod an set forth by 
Michael Zieky and^lfiiuel Livingston in Manual for Setting Standards on the 
Basic Skills Assessment Tests (1977); panelists receive! copies of the Manual 
in advance of the conference. The task of the panelists was to determine a 
level of performance on the loultiple-choice tests that indicates readiness 
for regular freshman writir^ instruction and minimizes the probaMlity of 
placing in a' college course sttKients would be better served In basic 
skills courses in reading and/or writing. The Nedelsky method was considered 
appropriate because the Reading and Writing Advisory Committee had agreed to 
base cut scores on a content analysis of the test, and because the Nedelsky 
method had been used to sec cut scores at several New Jersey colleges « 



The Nedelsky Method 

The Nedelsky method for setting a basic skills proficiency cut score 
requires that a panel estimate the number of options in each test item that 
the minimally qualified student should be expected to eliminate as Incorrect. 
It Is then assumed that this student will guess and select at random from 
aiMng those responses not identified as wrong. On a NJCBSPT four-choice 
item, the student who eliminates no responses as incorrect has a .25 
probability of selecting the correct answer by random guessing; if one response 
can be eliminated, the student has a ,33 probability of selecting the correct 
response from the three not known to be wrong; if two responses are eliminated, 
the probability is ,50; if three are eliminated, the probability is one hundred 
percent (1.) that the student will identify the correct response. 

The sum of each panelist's probabilities is the panelist ^s estimated 
number of correct answers that the minimally competent student should score 
on the test* The panel's scores are added and averaged to produce the cut 
score. 



The First Day; Agreeing to the Ground Rules 

The first day began with an evening meeting that lasted from 7:45 
until 11: 15, The meeting opened with a general discussion of the nature and 
purposes or the New Jersey College Basic Skills Placement Test, the various 
statewide reports based on NJCBSPT data, and the need for statewide cut scores. 

It was agreed that, once established by consensus, the ground rules nust 
be heeded and panelists should remain for the conference only if they couii 
in good conscience support the panel's tasks and methods. 

The panel also agreed to develop rubrics to be used in judging the 
niultiple-choice rest and the essay, to establish cut scores for the n:ulti?le- 
cnoice test using the Sedeltky :nethoa, and to assess the essays for zollege- 
level vritiag. 
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There was discussion of the multiple-choice test judgoienc rubri*\, 
focusing on "should" and proposing ''would*' in the key question: 

How many of the discractors on this item should the entering 
college freshman be able to eliminate as clearly incorrect? 
3y definition, a college-level freshman does not need 
remediation* 

It was finally agreed that "should/' in the sense of expectation or 
probability, was the appropriate word, and that "would," suggesting certainty 
or habitual action, was Inappropriate for the panel's task of determining 
faculty expectations of entering college students. (The should — would 
distinction plagued panelists throughout the two and one-half day conference,) 

The proficiency of the entering freshman was then discussed, and it 
was agreed that the panel was to consider those students thought by the 
freshman composition instructors to be appropriately placed in the first week 
of classes. Many of these sttidents might aot complete the course, some might 
fail. The panel's task was simply to estimate what an entering freshman who 
does not need language skills remediation should identify as correct and 
Incorrect multiple-choice distractors on a fairly easy test of language skills. 

The panel agreed to an essay assessment procedure, and to a rubric: 

Is this an acceptable essay for a college student entering 
a regular freshman composition course? 3y definition, this 
student does not need remediation. 

There was an extended discussion of freshman composition entrance 
standards (see Attachment C) ; the panelists agreed that the document could 
be accepted as a whole, and that while it was useful in stimulating and 
directing discussion, it could not be used to set sharply defined limits 
for the panel's work in setting cut scores. For this work, the panel agreed 
they could rely on individual judgment. 



The Second Day: Judging the Objective Tests 

The second day began with a review dz the -Tiultiple-^choice test rubric. 
Then, the panel leader read the rubric as each question was considered, and 
panelists were asked to ziark on a prepared scoring sheet (see Attachment 3) 
their expectation or probabilitv that a Tiinimally competent i^tudent in :i 
regular freshaan composition course should answer the question correctly, 
.Vftar the panelists privately recorded their probabilities for an iteai, the 
leader asked for a show of hands for each of the probabilities - .25, .33, 
•30, and 1. Usually there was disparity, and the panelists who ^ave the 
hi*;hest and the lowest probabilities were invitad to explain the reasons 
their decisions. This was followed by general discussion, and then <^ach 
panelist r-arked a final judgment on the scoring .-^heet; ihe :inal ;;-,;d^n:ont 
-ai-?.ht "^ti the saae ns the initial Dtie marked privately, or it nii^ht i-ave lu^en 
revi^sea a.s a result Dt the discussion. 
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Worklng through 125 items took seven and one-half hours oz intense 
concentration. The data derived from the Nedelsky Judging of the NJCBSPT 
multiple-choice language skills test are shown in Table 1. 

rhe^ Third Day; Judging the Essays 

On the third day the panel reviewed and agreed to the essay judging 
rubric: 

Is this an acceptable essay for a college student entering 
a regular freshmen composition course? 3y definition, this 
student does not need remediation. 

The panel's task was to read sixty pre-selected and pre-arranged 
essays drawn from earlier statewide essay readings (the essay topic is 
included as Attachment E) . These essays clustered around what experience 
suggested would be close to the borderline considered to be acceptable 
college-entrance writing. While there was a representative sample of essays 
at all but cne score level within the 2-12 range, there were relatively few 
samples from the extremes— and no top scoring essays— ihis in order to save 
time and to focus attention on the middle range where judgment establishes 
cut scores. 

In earlier statewide essay readings the sample essays had been scored 
independently by two experienced readers using individual scores of 1-6 to 
produce the total score of 2-12. (For a full explanation of the holistic 
i:coring procedure, see the New Jersey Basic Skills Council publication, 
Scorini^ the Essays on the New Jersey College Basic Skills Placement Test . ) 
Panelists were not told these earlier scores; in effect they were defining 
the readers' scores in cenns of college-level writing. 

Tiie panel read 60 different essays and classified them in two groups; 
essays judged to demonstrate an acceptable level of writing for a college 
student entering regular freshman composition course, and essays judged to 
be below that level. -\s with the multiple-choice test judgments, there vas 
discussion and some score changes before the final judg:nent3 for each essay 
were recorded on a score sheet (a sample score sheet is ir.cluded as Attachment . 

A tally of the panelists' judgments, together vich the actual score :'ot 
each assay, is presented in Table 2. 

The general pattern of the panelists' response tJ the essays similar 
to that of the essay readers, and it is clear that in the average jud^ent :'t 
the panelists an essay receiving a score jf 7 or more is acceptable vririn^ 
for a student entering a regular college freshman composition course. 

There are a few anomalies in the ci:t score table. For the niosc part 
these reflect the fact that the panel xembers (niany oi whom al.-^o participate 
;.n the holistic readings) are, wnen they read a paper in terr.s n" the writer's 
:v-ed for reTr.ediac ion , asking questions iomewhat Jifferent from the -;viesti--;ns 
reaaoro ask vhen tney read a paper in ter-ns Jt its overall value. 
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TABLE 1 



Table of Paitelisc's Scares on the NJC3SPT Objeccive Tests, 

and the Derived Cut Scores 





Reading 


Sentence 


Logical 


Panelist 


Comprehension 


Structure 


Relations 


1 


28.49 


23.66 


37.32 


2 


30.83 


27.16 


40.33 


3* 


27.49 


22.58 


36.15 


4 


29.99 


23.24 


39.16 


5 


31.33 


26.49 


40.82 


6 


31.00 


23.66 


43.33 


7 


31.16 


25.16 


40.83 


a 


28.58 


25.24 


37.16 


9 


27.23 


24.08 


40.49 


10 


35.83 


31.83 


47.00 


11 


31.50 


2&.00 


41.50 


12 


35,50 


28.33 


41. 66 


13 


30.82 


24.41 


44.33 


14 


30.98 


27.33 


39.83 


15 


24.32 


22.66 


43.50 



Average 

Raw 30-34 25.95 40.93 

Score 



Cut Scores 

(Average Raw Scores 165 165 

Converted to 
Scaled Scores) 
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PANELIST R£SPQ?SE TABLE 2 

(Is fchla college level?) 
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ESSAY NUMBER 


SCORE 




YES 


NO 


9 


•> 




0 


15 


24 






0 


15 




3 




0 


1-4 


11 


3 




0 


15 


3 


4 






13 


17 


4 






11 




4 




0 


15 


28 


4 




•> 


13 


55 


4 




0 


15 




5 




1 


14 


8 


5 




8 


7 


12 


5 




3 


1 


16 


5 




6 


9 


20 


5 




7 


8 


25 


5 




10 


5 


29 


5 




1 


14 


30 


5 




3 


12 


39 


5 




2 


13 


49 


5 




0 


15 


1 


6 




9 


6 


3 


6 




11 


•4 


10 


6 




1 


14 


13 






12 


3 


15 


6 




13 




19 


6 




7 


3 


32 


6 




0 


15 


42 


6 






1- 


45 


6 




3 


12 


54 


6 






1 T 
■A.- ~# 


60 


6 




3 


^ n 

^ MP 


14 


/ 


Cut Score 


15 


0 


26 






12 


3 


31 






15 


0 


34 






13 




35 








S 


37 






15 


) 








6 


9 


52 










56 
















58 


/ 






0 


39 


1 

t 




15 


0 




S 




15 


0 


IS 


3 




14 




:i 


3 




15 


) 




s 






1 


33 


S 




15 


.) 




3 








46 


8 




12 


.3 




3 






■} 




3 






♦ : 


~ 


3 








- 






13 


J 


36 


9 




13 


j 


38 






• ^ 


J 


•o 


9 




• ■> 




50 


'} 




13 




■iO 


10 




13 


> 
J 


51 


10 


10 


13 


t 


23 


11 






41 


11 




13 


0 
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Panel Findings 

The panel's exercise with the Xedelsky method produced the folioving 
NJCBSPT cut scores (scaled scores): 

!• Reading Comprehension 165 

2, Sentence Structure 165 

3, Logical Relationships 168 

4, Essay 7 

5, Conposition (2 4-3 + 4) 169 

6, Total English (1-^2-^3+4) 165 
The panel agreed to meet and formally adopt a report. 
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ATTACHMENTS 



Description of the SJCBSPT 

Conference Panelists 

The Writing Rubric 

Nedelsky Method Scoring Sheet 

NJCBSPT Essay Topic 

The Essay Rubric and Scoring Sheet 
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INFORMATION 
BULLETIN 1980 

NEW JERSEY 
COLLEGE BASIC SKILLS 
PUCEMENTTEST 

State of New Jersey • Board of Higher Education • 
Department of Higher Education • Basic SItilis Council 




JHIRPOSEOFTHETEST 

"Ow Nw uiin<if CoHege Bask: Skilte Placement Ttet te (te- 
^gned t.** --f^u you now that you have beerr ac&nitted to a 
New Jersey puWte Of partidpattoig private coitogo by jMovi^ 
ing informatton about yoiff individud skUis in tan^i^ and 
mathematics. This infomiatlon will assist you and your 
counsakK in meriting d acisiw s Miout ttw tttrals cA ccwrses 
you are prepared to take. T\m inf omiation wilt be used to tito- 
tem^ine whetnor or not you need special help in panicuiar 
areas in order to succeed at cdlegeMevel work and to assist 
in piecing ywi in particular courses or ccMirse sections 
suited to ycxjf preparation. 

The test rrwasures your skiHs in ro«^. writliHJ. com- 
putation, and eiememary algebra. TN» full test r«^res 3 
hours and 15 minutes. Except for the 20-minute essay 
section, the lest is made up entirely of multiple-choice 
questions. 

WHO MUSTTAKETHETEST 

The New Jersey Board of Higlwr Education requires that 
the following students take the test: 

• alt freshmen who will be entering a New Jersey ;»jttic 
collet in the fall of 1 978 and at any date thereafter; 

• ail full-time and part-time freshmen who are seeking a 
degree; 

• any student who does not initially seek a degree but who 
registers for a course tf»t would result in the accumuta* 
tion oil 2 or more credits; 

• any freshman transfer student wtw has not taken the 
test. 

An institution may require additk)nal categories of freshman 
students to be tested. Also, a nun^)er of prhrate colleges 
have ct^en to participate in the testing program. 



Studems will be tested only after they have been ad- 
mitted to a coMe^. Rrst-time students who hold a bache- 
k^'s degree rwed not be tested. Stunts enrdied in a bilirv 
guai oc English as aSecond Uw^uage (ESL) program will be 
tested when they have completed such a program. 

WHERETHETESTWia BE GIVEN 

The Basic Skills Placement Test will be given at all New 
Jerse> ptAllc and participating private colleges. Your col- 
lege ¥vill notify yai where on campus the twt will be ad- 
ministered. 

WHEfj THETEST WILL BE GIVEN 

Ei^ cdlef^ will schedule titw date and time for admims- 
loring the test to its students. Ybur college will notify you of 
the date on which the test will be ai^inistered. 

WHATTO TAKE WITH YOU ON 
THE DAY OF THE TEST 

On the day of the test, be sure to take with you 

• Your Social Security Number 

• Several fto. 2 l«»d pencils with erasers 

• A pen for writing the essay 

TESTING REGULATIONS 

No bo(^. dicti(^n«», electronic calculators, or papers 
of any kind are altowed in the test rocm. Anywie who gives 
w receives help during the test, uses notes or books or 
ps^rs of any kifKl, or removes test materials or rwtes from 
the room will not be jxmnitted to cwtinue the test. The col- 
lege will invalkJate any test score if there is any reason to 
question its vallcflty. Befwe exercising this authority, tfie 
college will offer the student an opportunity to take the test 
again. 
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AHfigms ff«efv9d 
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TEST SCORES 

AH scores will be reported to your coJiege. and your college 
will determine the pr^edures for conminlcattr^ informa- 
tiOT about test rwults to y<HJ. 

You wSI recetve a More for each sectiOT ol the test. This 
means yw vwH receive a score for the Essay, Reaflr^ Cotv 
prehension, SentefKe Structure, Logical Relatiwiships, 
Computation, and Elementary Algebra, In adcfition, you will 
receive a Con^xjsittan score (macto iq' VWi^ scores on the 



Essay, Sentence Structure, and Logical Relationships sec- 
tions of the test) and a Total English score (mad€i» up of your 
scores on the Essay, ReMBng ComorehensiOT, Sent^we 
Structure, awJ Logical Relatiorohif^ sectiws of the test). 
f=or Feeding Ccynpreher^ii^, SentefK;e Structure, and Logi* 
cal ReiatK^ships, you v^H atso receive cluster scores, that 
is» scorra for clusters of questicxts ctealif^ vwtti certain as- 
pects of the mam skill tested. You wll mjt rt^ceive cli^ter 
scores for the Computatiw ar«J Elementary Algrt)ra seo- 
tkm of the test. 



QUESTIONS AND ANSWERS ABOUT THE NEW JERSEY COLLEGE 
BASIC SKILLS PLACEMENT TEST 



a Why am I being asked to take this test? 
A. The results of this test wiH help place you in courses 
for which you are best prepared. 

Q. Is this an admission test? 

A, No The test has nothing to do with your being ad- 
mitted to college, in fact, you will not take the test 
until after you have been admitted. 

I have not yet been admitted. Can I stili take the test? 
A. No, You will have to wait until you've been admitted 
to college. 

Q, i have taken courses at another college. Do I need to 
take this test? 

A, Yes. All freshmen who have not taken this test must 
do so. 

Q. ! have taken other^ standardized tests for credit or 
placement. Do I need to take this test, too? 

A. "^es. The test is designed to give you and your college 
advisors information diSferent from that provided by 
other tests, 

Q. I am not sure whether or not I am required to take 

the test. What should I do? 
A, The staff of the Admissions Office of your colle )e will 

De aoie to answer your question or direct you to the 

appropriate otfice. 

What iS the passing grade on the t3St? 
A. You neither pass nor fail this test. Instead, your test 
results will be used to place you in courses accord- 
ing to your present skills. 

Q. Why are you testing English? 

A. Reading and wnting skills are essential for success 
in college. You must read well enough to understand 
/our college textbooks and write well enough to pre- 
pare term papers and complete essay tests. 



Why are you testing mathematics? 
A. Certain quantitative skills and mathefnatical con<»pts. 
are necessary for success in many ^asesof college- 
level work. These are the skills arKl concepts tt» 
test measure. . ^ 

How do I prepare for the test? » 
A. You need not do anything spwial to prepare for this 
test. It measures reading, writing, and mathematics- 
skills which are developed over a period of years. 
Come to the lesi ready to use what you have learned* 

Q. I have completed high school. Shouldn't I be ready 
for college-level work? 

A. PfobatJly. But. if you have not had very much prac- 
tice in writing essays or \n careful reading or in basic 
mathematics, you still might benefit from special 
instruction. 

0, Suppose I don t do well on the test? 

A^ Your college will interpret the results of the te^ and 

determine which courses you are prepared to take. 

Your score will not affect your grade point average in 

any way. 

Q. Will I have to pay a fee to take the test? 
A. No, The State of New Jersey has provided funds for 
the development and the administration of the test 

Q. Where do I take the test? 

A, Get in touch with your college tor the place and time 
of testing. 

Q, How do I find out how t did on the test? 

A. A report will be sent to your college On the day of 

the test, you will be told the reporting procedures 

your college will use. 
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DESCRIPTION OF THE TEST 

The first part of the test measures your skills m certain 
areas of English. It ccxisists of four sections; Essay. Read- 
\ng. Sentence Structure, and Lexical flelatic^ships. These 
sections of the test are designed to sfxw your strengths 
and weaknesses in particular skills and to d€»termine 
wttethar or not those skills are at a level that ifKlicates yc^ 
are prepared to begin regular cdHe^ courses. 

The seccrtd part of the test nmasures ycHjr quantitative 
and eiementary atgebra ^ils. It consists of t^ sections; 
Con^tation and Elementaiy Algebra. 

The foikming paragraf^ will tell ycHi more atxxit the 
English ami Mathenraticr srctions of the test. 

Tlw Esaay. You wlH t» given ^ nninutes to write an essay 
on an assigned toptc. In such a short time, you may not be 
able to write a polished essay because ycHJ will not have 
time to rewrite what you have writtm. In ger^al, \tm scor- 
ing of ycHir essay wii( take into accc^mt f^ well you phrase 
your ideas and organize ttwn. whether ycu use specific ex- 
amples to support your icteae, ar^ whether you follow the 
conventions of standard written En^ish. 
RMdiffig Comprehensloo, 30 minutes. 40 queetiona This^ 
section of the test indicates fiow well you wderstaiKJ what 
you read. You v^ll t3e given short passages to read and 
asked to answer questions about tfK)se passages. In addi- 
tion to a total score for Readir^ Comprehension, ywJ wilt 
receive cluster scores to let ycu kxKW how well ycni under- 
stand main ideas, understand cSrect statements, and Know 
how to make inferences. 

Sentence Structure. 30 mmutes^ 35 creations. This sec- 
tion of the test indicates how much you know atx>ut the way 
parts of a sentence fit together. You will receive cluster 
scores to tell ycHi how well you uruterstar^ wtiat complete 
sentences are. how coordination ar^i sutsordinatiOT should 
t^e used, and where modifiers stKHitd be placed* 

Logical Reiationahipa* 30 minutes, 50 questions. This 
section of the test imlicates how v^ll you unoerstand the 
logical reiationsmps between words, between ideas, and 
Detween sentences. In addition to a total score for Logical 
Relationshtps, you will receive cluster scores to let you 
know how well you categorize ideas, use awjropriate con- 
nectives, make analogies, and recognize principles of orga- 
nization 

Computation. 35 minutes, 30 questions. This section of the 
test measures your ability to perform oasic arithmetic oper- 
ations and to solve problems that inv-oive fundamental arith- 
metic concepts. The questions cover operations with wnoie 
numbers, operations with fractions, operations wtth deci- 
mals and percent, and aritfimetic reasoning. You will re- 
ceive a total score for Computation. 

Elementary AlgetNa^ 35 minutes. 30 questions This sec- 
tion of the test measures your ability to perform basic alge- 
braic operations and to solve problems that involve eiemerv 
tary algebraic concepts. You wifl be tested on operations 
with real numbers, operations with aigeoraic expressions, 
and the ability to solve equations, inequalities, and word 
problems You will receive a total score for Elementary 
Aigeora 



Many different kinds of multiple-choice questions are 
used m the test. A sample of these questions and of an 
essay topic follows. The answers to the multiple-choice 
questions appear on page 6. 



L THE ESSAY 

Yoti will have 20 minutes to plan and write an essay on a 
topic like the one below. Read the topic carefully before 
you begin writing. Your essay should be well organized 
and carefully written. Be sune-to use specific examples to 
sup|>ort your id^. Write only on the topic assigned; an 
essay on another topic will receive no credit. 

"rou may want to write an essay on this sample topic 
for practice. 

Almost every home in the United States has a tele- 
vision set. and it cannot be denied that television 
exerts a considerable influence on us. Is that influ- 
ence a good one, a bad one* or a Htde bit of both? 

la a well*organized essay, give your ansiAW to this ques- 
tion. Be sure ta give the reasons^ for your opinion and to 
sup(K?rt your ideas with specific examples. 



il. READING COMPREHENSION 

Dlrectl^me: The passage below is followed by questions 
based on its content. Answer ail questions following the 
passage on the basis of what is stated or suggested in iL 

QtieettoRS 1-3 

As the official "no swimming" signs t>eccme a common 
sight along the shore of Paradiso Lake, the major hotels 
are rushing to complete huge lakeside pools in time for 
the summer invasion of tourists. 

1, According to the passage, why are the hotels rushing 
to build pools? 

(A) They want to seem much more 'uxurious than 

they can really afford to be. 

(B) There will be new taxes on pools this summer. 

(C) People will probably not be able to swim in the 

lake this summer. 

(D) Tourists usually prefer swimming m pools. 

Z The use of the word "invasion" suggests what atx)ut 
the tourists'^ 

(A) There will be a great many of them alt at once. 

(B) They will come dy ship. 

(C) They have never been at the lake before. 

(D) There wili be a great deal of mcney spent to 

please them, 

3L Where are the "no swimming ' signs'^ 

iA) At one or two hotels 

fB) At tne hotels 

(C) At one or ♦wc oiaces on tro ^.nore 

{D) At a cjreat ^any places tr^e 3ho^e 
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III. SENTENCE STRUCTURE 

Dlrecthms: Select the best version of the underlined part 
of the sentence. Choice (A) is the same as the original 
sentence. If you think the onginal sentence is best, choose 
answer (A). 



Ancient Greeks ate with their fingers, wiped them ot 
pieces of bread, and tossed them to the dogs lying 
under the table. 

(A) tossed them 

(B) tossing them 
^C) tossed ihe bread 
(D) they tossed 



A B C D 
0 0 • 0 



4. Tony backed out of the garage, justttren M&ria turned 
into the dnveway. ; 

(A) gar^e. }ust then Maria turrwd 

(B) garage, with Maria just then Uiming 

(C) garage at that time Maria turned 

(D) garage at the sanre time that Maria turned 

5, Walter \s wearing me blue shirt standing next to 

Louise. 

(A) Walter is wearing the blue shirt standing next to 

Louise. 

(B) Walter, wearing the blue shirt, is standing next 

to Louise. 

(C) Walter is standing next to Louise in the blue shirt. 
(Qj Walter, standing next to Louise, in the blue shirt. 

Oirectlcms: in the following questions, you will be asked 
to rewrite sentences m your head. You will be told ex- 
actly how to begin your new sentence. Keep tn mind that 
your new sentence should have the same meaning as 
the sentence given you. 



Example: 

Being a female lockey. she was often ndiculed. 
Rewrite, beginning with 
She was often ndiculed 
The next words will be 

(A) on account of she was 

(B) by her being 

(C) because she was 
(0) being 2S she was 



A 8 

0 0 



c 



D 

0 



czra decided to walk home after ne mtssed the last 
bus. 

Rewnle, beginning with 
Havi ng missed tne last tjus . 
The next words will be 

(Ai Ezra's decision was (B) walking home was 
(C) Ezra decided (D) then Ezra decided 



This Disease is carried by mosquitoes, arxJ it has 
killed seventy people so far. 
Rewrite, beginning with 

So far, saventy pe<^le have died of this disease 

The next words will ba 

(A) which is carried 

(B) although it is earned 

(C) havir^ been canled 

(D> with mosquitoes carrying 



IV. LOGICAL RELATIONSHIPS 

OirectkMUi: For these questions, choose the object that 
is a specific example of the category underlined. 



fruit 

(A) tree 

(B) apple 

(C) wood A B C D 

(D) crop 0 t 0 0 
(B) is the correct answer because apple is a specific 
example of fruit. Even ttwugh fruit may grow on a 
tree, a fruit tree may be a source of wood, and fruit 
fray be a kind of crop, only (B) apple is an example 
of a fruit. 



IL building (A) walls (B) cave 

(C) foundation (D) house 

9. gem (A) gift (B) ring (C) diamond (D) jewel 

Otrttcliofis: For these questions, choose the category in 
which the two underlined words belong. 



apple, ora ie 



(A) pit (B) yellow 
(C) shape (D) fmit 

ABC 

0 0 0 



D 



(D) is the correct answer t»cause fruit is the general 
category that includes apple and orange . An apple 
and an orange may have piis, be yellow, and have 
shape, but none of these characteristics indicates 
the category under which apple and orange may be 
classified. The only word that names the category is 
(D) fmit. 



10. fobtn. owl (A) nest (B) feathers 
(C) wing (D) bira 
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11. mother, actress 



(A) woman (B) house 
(C) family (0) film 



Diractlom: Choose the word or phrase that best com- 
pietes the meansrtg of the sentence. 



Mrs. Brown wanted to cook a turhty. 
found she did n(A have the time^ 

(A) but 

(B) while 

(C) or 

(0) consequently 



SfT# 



A a C D 
• 000 



12. The school was named for RotMrto Cienrtenta 

he r^ains for many young people a symbol of fine 
character and physk»l prowess* 

^) when 

(B) because 

(C) while 

(D) in order that 

13. Pauline just stood there looking amazed Mr, 

Jones was telling her that she had won the contest, 

(A) while 

(B) thus 

(C) nevertheless 

(D) even if 



Directions: in this group of questions, two or three under- 
lined sentences are followed by a que^ion or statement 
about them. Read each group of sentences and then 
choose the best answer to the question or the best com- 
pfetton of the statement. 



The Midwest is experiencing its worst drought m 
fifteen years . 

Corn and soybean prices are expected to be very 

high this year . 

What does the second sentence do*^ 

A B C D 
0 f 0 0 

(A) it restates the tdea found m the first. 

(B) It states an effect 

(C) It gives an example. 

(D) It analyzes the statement made in the first. 



14^ The painting is on the wall next to ttie small oval 
window. 

The heavy chair is under the paintin g. 

The objects m the sentences are organized accord- 
ing to 

(A) their size 

(B) their shape — ^ 

(C) where they are ptaced 

(D) how attractive they look - ? 

15. The two bois, John ara Leroy. are the same heiqht 
John is heavier than Leroy, 
What is happening in the sentences? 

(A) Two tK>ys are being used as examples. 

(B) Two boys are being compared. 

(C) Heigtit is made similar to weight, 

(0) Weight is made more important than height 

1& t^rry is extremely neat - 
. Ttwe re never a paper out of place on his desk. 
How are the two sentences reialed? 

(A) The secorKJ s^ence gives an example of what 
' is talk^ about in the first. 

(B) The second sentence contradicts the UrsL 

(O Thfl second swtence compares Hany to ott^r 
people. 

(D) The second sentence tells what caused Harry's 

neatness. 

IHrac^Nit! Choose the word or phrase that tMSt com- 
pletes the meaning of the sentence. 



Puppy is to dog just as 






(A) lion is to jungle 






(B) kitten is to cat 






(C) baby is to child 


ABC 


0 


(0) leaf is to tree 


0 • 0 


0 



ExetiH^: 

Gasoline provides energy for a car just as sugar 
provides energy for a , 

(A) die! 

(B) cake 

(C) human being 
(0) cup of coffee 



A B C D 
0 0 • 0 



17. A chef cooks meals just as a truck dnver 

(A) delivers goods (B) belongs to a union 
(C) works eight hours (0) uses diesel fuel 

18. Tall is to short as happy is to , 

(A) merry (B) smile (C)- wise (D) sad 
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V. COMPUTATION 



VI. ELEMENTARY ALGEBRA 



(KrMittoiw: Solve each of the following problems. 



Ofracflom: Solve eacti of the following problems. 



1. 601 - 49 = 

(A> 562 (B) 552 (C) 548 (0) 111 

2, Whtcft of the followtng is greatest? 
(A) I (B) ^ iC) ^ (D) I 

3w 23.5x3.04 = 

(A) 714.4 (B) 79.9 (C) 71.44 (D> 7.99 

4. What is 12 percent Of 150? 

(A) 1.8 (B) 18 (C) 180 (D) 1.800 

5u aiHpurcr»sedacarandn«itea(iOMm(»yfTwntof 
$560. If the <lawn payment was ^of the purchase 
orice, wfiat was the inirc^»s» prica? 
(A) $112 (B) $2,240 (Q $2,800 (0) $4,480 



aL If X = 4 and y = - 2. then x*y - xy* = 
(A) 48 (B) 16 (C) -16 (0) -48 

7. Vie » . 

(A) 2 (B) 4 (Q a (D) 54 
ft If2x + 3(x - 2) a= 29.thenx - 

(A) ^ (B) ^ <C) 7 <D) 30 

ft One factor of 3a* - 13a - 10 ia 

(A) (3a + 2) {B)(3a-5) (C>{a"K2) (D) (a + 5> 

10L ThestateiTwnt."xis2morethany"can{ 



(A>x>y-2 (B)<>y+2 
(Qx = y- 2 (D)xs=y+2 



KEY TO 9MmM QUESTIONS 





CENGUSH) 






(MATHEMATICS) 




1. c 


7. A 


IX A 


1. B 


ft C 


ft A 


2. A 


t. 0 


14w C 


2. A 


8L 0 


1ft 0 


X 0 


IL C 


1ft B 


ft C 


r. A 




4. 0 


IflL 0 


1ft .A 


«. B 


ft c 




s. a 


11. A 


17. A 








& c 


12. B 


1ft D 
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BASIC SKILLS COUNCIL 


Dean William Oaly 


Dr. FredefJC Kreisier 


Stockton State Cc^ktga 


Otijartment of Hi^r BOucation 


Or. Anthony OKaiorgto 


Or. Amy Ung 


Trwit&i State Cai^ge 


Rutgofs UnnmsitY--Ljvingston 


Or. Oe^)ert Ear^nw 


Or. Edward Morante 


UpsalaCot^ge 


Nsw ./SfS9y if&ntute of rec/mo^ 


Or. Donald BOge 


Mr Richard ^hJrsa 


Basic Sk^s Council 


Rutgofs Uniwrsipf—New Bnmwick 


Mr E(Ason Jackson 


Professor L Alice Peters 


£ssex County CoUege 


Augdn Community Cortege 




Or Charles Pine 




Rutgers University— Newark 



s 
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ACtachment B 



Panelists 



klllan Anthony, Coordinator of Basic Skills 
Essex County College 

■llian Chambers, Supervisor, Basic Skills 
Educational Improvement Center /South 

«seph I^Pierro, Associate Professor of Reading Education 
Set on Hall Univarstly 

.Ibert Earisman, Professor of English/Basic Skills Director 
Upsala College 

^oald Edge, Director, 

New Jersey Basic Skills Council 

?rry S, Friedman, Director of Developmental Studies 
Centenary College 

ances Lynn Galbraith, Teacher of English/ Comnunity Relations Coordinator 
Lenape Regional High School District 

ivld Hoddeson, Director, Writing Program 
Rutgers University — Newark 

tomas J. Humphrey, Vice-Principal, Program BASIC 
Trenton Central Hijh School 

ederic F. Kreisler, Director, Office for State University & Professional Schools 
New Jersey Department of Higher Education 

lliam Lutz, Chairman, English Department 
itgers University — Camden 

isan P. McNamara, Chair, English Department 
William Paterson College 

^rtha L. Palmere, Supervisor, Language Arts S Social Studies 
West Winds or / Plains bo ro High School 

'Seph L. Papay, Chairaan, Philosophy Department 
St. Peter's College 

■n Patrick, English Department Coordinator 
Sterling High School 

chard Swartz, Coordinator, Academic Foundations Program 
Camden County College 
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Attachment C (2) 



Standards for College-Level Entering Students 

Key to (3/6): Of tlie 6 colleges responding to a poll, 3 proposed 
that standard. 

Reading 

In order to read at college-level, a student must demonstrate with 
material typically assigned in freshman college classes: 

1. an ability to understand main idca-v supporting evidence, and 
inference for various types of discourse (3/6). 

2. an ability to read at the literal, int:rpretive, and 
critical levels (3/6). 



Entrance-Level Standards for a College English Course 

In order to enter a college-level English composition course, a 
student must demonstrate the ability: 

1. to employ the conventions of formal written English, including 
sentence structure, punctuation, and spelling. 

2. to employ various rhetorical patterns by which ideas may be 
arranged in written English, and an ability to write paragraphs 
and shor-_ themes that denwnstrate a knowledge of these pat tarns. 

3. to critically evaluate written ideas and to write a paragraph 
that shows evidence of logical thinking. 
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Attachment F 

RATER: 

(Name) 



Is this an acceptable essay for a college student entering 
a regular freshman composition course? 3v definition, these 



students do not need reo^diation. 

/ YES / /' NO ] } YES / / NO / / YES / £nO 

1. 21. 41. 

2. 22. 42. 

3. 23. 43. 

4. 24. 44. 

5. 25. 45. 

6. 26. 46. 

7. 27. 47. 

a. 28. 48. 

9. 29. 49. 

10. 30. 50. 

11. 31. 51. " 

12. 32. 52. 

13. 33. 53. 

14. 34. 54. 

15. 35. 55. 

16. 36. 56. 

17. ' 37. 57. _ 

13. 38. 53. 

19. 39. 59. 

20. 40. 
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DEPARTMENT OF HIGHER SDUCAT'ON 
229 WEST STATE STREET 
P. O. BOX 1293 
TRENTON, NEW JERSEY QSaZS 



MEMORANDUM 



July 22, 1980 



TO: 



Basic Skills Council 



FROM: 



Donald Edge, Director 



SUBJECT : Weekend Nedelsky Conference: Recongnendacions and Conclusions 



The weekend Nedelsky conference was spent establishing cut scores 
for the NJCBSPT langijage skills tests and essay, and a conference report, 
reviewed and approved by the conferees, has been sent to the Council with 
copies to the Tests and Measurements Coramlttee. The report will serve as 
one part of the rationale for the cut scores the Council uses in Its annual 
report to the Board of Higher Education on the basic skills proficiencies 
of students entering Sew Jersey public colleges and universities in the 
fall semester. 

Other satters were disciissed at the conference, and three became 
panel recocsaendatlons: 

Reconanendatlon 1 

The NJCBSPT should be strengthened by (1) deleting three clusters — 
Placing Modifiers Appropriately, Categorising Ideas, and Making Analogies; 
(2) adding to Reading Comprehension a cluster testing the ability to recog- 
nize the difference between a main idea and its supporting details; using 
item types :hac demand critical thinking skills. 

Recommendation 2 

In evaluating writing, an essay is absolutely necessar:/, and the essay 
topic should invite the writer co draw from a full range of critical chinking 
and organizational skills so that the evaluator can sake objective and discrim- 
inating decisions. 

In writing assessment, expository essays are 3ore appropriate rhan 
narration and description, since these invite limited organizational :ecrr.iques 
and may Pleasure imagination and experience rather t.han writing. 
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In addition to narration and description, exposition should be taught 
beginning in the elementary grades; however, since ^"ff ^^^^^^^^^^^^^^ 
essays have limited uses for evaluation and do not readily admit <'bj«cive 
judgLnt and a full range of scores, at all levels only expository «ssay 
topi^ should be assigned when the essays will be us.i for placement and/or 
assessment, 

Recomnendatlon 3 

Expository writing should be given more attention than it now receives 
in secondary schools, and an expository essay should be included in the 9th 
grade Minimum Basic Skills Test as a aeasure of the basic writing slciix most 
often demanded and nwre readily evaluated. 

The secondary school panelists .«»grced to an independent recoomendation: 

RecQganfendatloa 

The nature and relative difficulty of the NJCBSPT suggest that this test 
or a ^rsion ol it could be administered in place of the llth grade Minimum 
bLL Skills Test to aU Uth graders who have successfully completed the 9th 
er^e the LSsFT elementary algebra test, however, should be administered 

onrtf thise high school students '^o have taken an elementary algebra course. 

Here are some concluding comments concerning the panel's limitations and 
potential: 

Limitations of the Panel 

1 More minority panelists were needed, although experience indicates chat 
minority and non-minority professionals produce similar ratings. 

- Panelists did not take the test beforehand to become familiar with it 
and CO prepare for the evaluation procedure. It might be argued that 
this was not a limiting factor. 

3. TO save discussion time, correct answers to the ^^"^uage skills ^Itiple- 
choice test items had been identified by pencil check marks. This .as 
not a help but a hindrance, and it may have affected '^h^^™^^/^"!^" 
butlon of error. Seme panelists covered these check marks, some added 
checks to all items, but none of this should have been ^^cessary. Ic 
•-,as the perception of the panelists chat the marks did not affect their 
scoring . 

4. The cut scores were arrived at through a ora-determined -nethod: alternative 
approaches were never explored. 



There is no empirical proof demonstrating chat the NedeUky Method 

Superior to the Angoff Method (explained in the Zieky and Livingston >lanual) 
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Reason suggested that finer distinctions would be made by the method 
calling for the panelists to make three decisions about each item, 
rather than the single decision about each item called for b/ the 
Angoff Method. (More decisions increase the likelihood of error, but 
the error is likely to be randraaly distributed* and positive and negative 
error tend to cancel each other out.) 

6. The cut scores were based on minimum proficiency. A second cut score 
indicating demonstrated proficiency would produce three useful placement 
categories; (1)' deficient; (2) marginally prof ic lent— to be decided 
according to each college *3 standards; (3) proficient. 

7. There was not enough time for the panel to compare their item analysis 
with other Itan measures (deltas, r-biserials, etc.). An item an^ysis 
comparison might shed some light on the relative validity of the Nedelsky 
method for setting cut scores. 

P otential of the Panel 

' ' I' 

The secondary education panelists have demonstrated expertise, represent 
administrative and academic organizations, and, given their familiarity -rfith 
the NJCBSPT, should be part of any joint conaaittee intending to study coop- 
erative secondary /post-secondary basic language skills testing and remediation. 



cc: Chancellor Hollander 
Panelists 
Frank Winter 
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